GIAN Program on BIG DATA will be held at the Discipline of Mathematics, IIT Indore during 26th October-1st November, 2016
Topic: Big Data Stream Analytics
Overview:
Over the last decade, we have witnessed the emergence of data-intensive applications that need to handle very large flows of data. Examples of such applications include network monitoring, financial applications, security log, and sensors applications. For all these applications, there is a growing need for (new) techniques capable of monitoring or analyzing these streams to detect outliers, intrusions, unusual or anomalous activities, complex correlations, extreme events, or the emergence of patterns. These techniques are grouped together under the term “Big data stream analytics”. These techniques must be capable of processing the input data quick enough to keep pace with the rate of the stream. The solution adopted to process such data streams is to trade off accuracy for space. Actually, one of the specificities of data intensive applications is that they do not require accurate responses to queries, only (high quality) approximate responses computed by summarizing the data are acceptable. Streaming algorithms, through synopses, handle such features. They read their input data sequentially and there is no requirement regarding the order in which data items are received. They use working memory whose size is much smaller than both the input size, and the domain from which items are drawn. There is a large panel of streaming algorithms that vary according to the number of passes they need to process their input process, the size of the memory they use, the time needed to process each read item, or whether they are randomized or deterministic.
Course participants will learn these topics through lectures and hands-on experiments. Also case studies and assignments will be shared to stimulate research motivation of participants.
Objectives:
The objective of the course is to
bring closer the vast applications of data streaming analysis
techniques. The course aims at proposing a comprehensive survey of these techniques, across
several practical usages (Statistical metrics over distribution of stream, distributed system safety
and network security, cloud monitoring and so on). The course will be presented with some
famous models of this research area and advanced algorithms, basics of which will be covered as
well. The course is aimed at the more general audience including mathematicians, statisticians,
computer scientists and electrical engineers. Applications will be illustrated by practical
examples. The participants’ knowledge about the course content will be raised to the level such
that they will be able to use the methods for their own applications and research.
